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ORIGINAL ARTICLE 

Pharmacokinetic-Pharmacodynamic Modeling of 
Severity Levels of Extrapyramidal Side Effects With 
Markov Elements 

V Pilla Reddy 1 , KJ Petersson 2 , AA Suleiman 2 , A Vermeulen 3 , JH Proost 1 and LE Friberg 2 

A major problem in the treatment of schizophrenic patients with current antipsychotic drugs, mainly acting as dopamine-2 receptor 
antagonists, is the occurrence of side effects such as extrapyramidal symptoms (EPS). Meta-analyses of summary data of EPS 
occurrence, and receptor occupancies inferred from mean plasma concentrations, have shown the incidence of EPS to rise when 
receptor occupancy is above -80%. In this analysis, individual longitudinal EPS data from 2,630 patients participating in one of 
seven different trials and treated with haloperidol, paliperidone, ziprasidone, olanzapine, JNJ-37822681 , or placebo were analyzed 
using a continuous time probability model with Markov elements. The developed pharmacokinetic-pharmacodynamic model 
describes the longitudinal changes of spontaneously reported EPS-related adverse events and their severity levels rated by 
clinicians. Individual steady-state concentrations and occupancy levels were found to be predictors for EPS. The results confirm 
80% occupancy as a level of increased EPS occurrence rates, also at the individual level. 
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Schizophrenia is a chronic psychiatric condition that includes 
positive (e.g., delusions), negative (e.g., lack of motivation), and 
cognitive symptoms (e.g., loss of memory). These symptoms 
can severely affect the social, educational, occupational, and 
health-related functioning of the individual. 1 Antagonism at the 
dopamine D 2 -receptor is a common mechanism of action for cur- 
rently available treatment of schizophrenia. 2 However, central D 2 - 
receptor occupancies (D 2 RO) >80% increase the risk of adverse 
effects (AEs) such as extrapyramidal symptoms (EPS). 3 

Extrapyramidal side effects of antipsychotic drugs (APs) 
include acute movement disorders, such as akathisia, and 
chronic movement disorders, such as tardive dyskinesia. In 
addition to being uncomfortable to patients, these side effects 
could behave as confounding factors and may lead to an under- 
estimation of efficacy of the APs. 4 In drug development, EPS 
symptoms are often assessed using rating scales, e.g., Simp- 
son-Angus Scale, or by spontaneous reporting by patients, 
with severity graded by clinicians at the time of planned visits. 

Atypical antipsychotics (ATAPs) were introduced to the clinic 
in an attempt to lower the EPS incidence as compared with the 
typical antipsychotics (e.g., haloperidol) and to improve the nega- 
tive and cognitive symptoms of schizophrenia. One of the claims 
during marketing ATAPs is "the absence of EPS side effects". 56 
Recently, a meta-analysis of ATAPs vs. haloperidol using a cen- 
tral tendency statistical approach to evaluate such a claim was 
performed. It demonstrated that at least some ATAPs do pro- 
duce EPS and that there are differences between drugs in their 
tendency to produce EPS. 6 Previously described assessments 
of EPS either looked at mean differences in Simpson-Angus 
Scale or EPS incidence on a study level 7 or at indirect measure- 
ments such as the prescription of anti-EPS treatment. No study 



has been published linking individual data of EPS to predictors 
such as plasma concentrations or receptor occupancy using 
pharmacokinetic-pharmacodynamic models that described the 
longitudinal aspect of EPS events following antipsychotic treat- 
ment. However, de Ridder and Vermeulen 8 modeled the time to 
the first treatment-emergent EPS-related event using hazard 
models, without considering the severity of the EPS events. 

The discrete nature of events or discrete scales as the ones 
used for EPS assessments may call for models that are appro- 
priate for the data. In the field of pharmacokinetic-pharma- 
codynamic models, one usable approach is the proportional 
odds model. However, this model does not assume depen- 
dency between observations and the profiles, and frequencies 
of transitions between states generated from simulations can 
be inconsistent with data. Markov elements would be needed 
to handle that property of the data. Another approach would be 
to assess the time-to-EPS of a certain severity using survival 
models, but these would not take into account serial correlation 
or that the probability of states are correlated. A "compartmen- 
tal" continuous time Markov type of model is capable of estimat- 
ing parameters considering time factor and hence eliminating 
the need of having frequent observations at equal spaces of 
time needed in ordinary Markov models or discrete-type mod- 
els. 9 A Markov-type model allows predicting the probability of 
observing a patient at any of the EPS severity grades, depend- 
ing on what severity grade he or she had at the last obser- 
vation and the time elapsed since the last observation. Thus, 
Markov modeling approach can help to quantify and compare 
the potency of different APs to induce EPS AEs over time. 

In this analysis, the aim was to develop a continuous time, 
population-based Markov model to describe the probability 
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of EPS incidence and EPS severity as a function of dose, 
individual steady-state drug exposure (C ss ), or predicted dop- 
amine D 2 RO of APs. All available EPS data after the admin- 
istration of placebo, four ATAPs (paliperidone-extended 
release, ziprasidone, JNJ-37822681 , 10 and olanzapine), and 
haloperidol from seven clinical studies were included. 

RESULTS 
EPS data 

The EPS data set consisted of 1 6,598 observations (rated as 
no EPS, mild, moderate, or severe) collected from 2,630 sub- 
jects with acute schizophrenic condition. Of these, 594 subjects 
received placebo, 867 received paliperidone (3-1 5 mg/day), 437 
received olanzapine (10 or 15 mg/day), 143 received haloperidol 
(2.5-40 mg/day), 285 received ziprasidone (40-200 mg/day), 
and 301 received JNJ-37822681 treatment (10-30 mg/day). 
Table 1 summarizes the trial designs and the observed EPS 
incidence rates of APs that were used in this study. Figure 1 
shows six individuals and their changes between the nc—mild- 
moderate/severe states. The calculated individual-level C and 

ss 

the predicted D 2 RO range (min-max) were as follows: for halo- 
peridol, 1-4ng/ml (55-98%); olanzapine, 9-76ng/ml (44-86%); 
paliperidone, 0.5-1 15ng/ml (9-95%); ziprasidone, 24-282ng/ 
ml (38-89%); and JNJ-37822681, 8-178ng/ml (35-92%). 

Structural model for EPS incidence 

To be able to calculate the probabilities of observing each 
EPS severity grade at any time point, the probabilities were 



determined by a Markov model with a compartmental struc- 
ture using differential equations (Figure 2). The placebo model 
was first developed based on the placebo data alone. There- 
after, the combined placebo and drug effects model was built 
by estimating placebo and drug effect parameters. Following 
the start of the study, the decrease of the rate constants as 
a function of time over the study period was best described 
by the exponential model (Eqs. 1 and 2). A linear model 
described the relationship between the drug exposure (Eq. 
3) and the effect of APs on the transition rate constants rea- 
sonably well. Modeling the drug effect, using dose or average 
C ss , as proportional to the placebo effect resulted in a better 
model fit and lower relative standard errors of the parameter 
estimates, as compared with additive drug effects. E max model 
was the best to link D RO and EPS events (Eq. 4): 
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Table 1 Overview of clinical trials in subjects with schizophrenia included in the development of the EPS model 



Study 


Design 


Study 
duration 


Route of 
administration 


Drug/dose 


Number of 
subjects 


% EPS rate" 
(95% Cl) c 


% EPS rate, 
model" 


Drug f K 


SCH-303 


Phase III, double-blind, 
parallel, placebo-controlled, 
randomized 


6 weeks 


Oral/once daily 


Paliperidone ER 6, 9, 1 2 mg 
Olanzapine 10 mg 


335 
122 


19(15-23) 
7(2-12) 


(21-30) 


23 h 
30 h 










Placebo 


116 


8(3-13) 


(9-23) 




SCH-304 


Phase III, double-blind, 
parallel, placebo-controlled, 
randomized 


6 weeks 


Oral/once daily 


Paliperidone ER 6, 1 2 mg 
Olanzapine 10 mg 


199 
101 


16(11-21) 
8(3-1 3) 


(18-30) 


23 h 
30 h 










Placebo 


97 


6(1-11) 


(8-24) 




SCH-305 


Phase III, double-blind, 
parallel, placebo-controlled, 
randomized 


6 weeks 


Oral/once daily 


Paliperidone ER 3, 9, 1 5 mg 
Olanzapine 10 mg 


333 
121 


21 (17-25) 
7(2-12) 


(19-29) 


23 h 
30 h 










Placebo 


107 


7(2-12) 


(9-24) 




128-114 


Phase III, double-blind, 
parallel, placebo-controlled, 
randomized 


6 weeks 


Oral/twice daily 


Ziprasidone 40, 80 mg 
Placebo 


131 

92 


26(18-34) 
20(12-28) 


(19-35) 
(8-25) 


7h 


128-115 


Phase III, double-blind, 
parallel, placebo-controlled, 
randomized 


6 weeks 


Oral/twice daily 


Ziprasidone 20, 60, 100 mg 
Haloperidol 10 mg 


154 
85 


29 (22-36) 
59 (49-69) 


(21-35) 
(63-83) 


7h 
10-30h 










Placebo 


82 


20(11-29) 


(8-24) 




SCH-2002 


Phase II, double-blind, 
parallel, placebo-controlled, 
randomized 


6-1 2 weeks 


Oral/twice daily 


JNJ-37822681 1 0, 20, 30 mg 
Olanzapine 1 5 mg (thrice daily) 
Placebo 


301 
93 
103 


24(19-29) 
15(8-22) 
6(1-11) 


(27-36) 
(8-24) 


30 h 


LMU 


Open-label study 


4 weeks 


Oral/once daily 


Haloperidol 2.5-40 mg 


58 


95 (89-100) 


(72-92) 


10-30h 



Americans (18%), Asians (7%), and others 
and concomitant medications for treating EPS: 



Demographics included in this analysis: gender: males (55%) and females (45%); race: Caucasians (67%), African 
(6%); geographical region: United States (-41%), Eastern Europe (-35%), Asia (-10%), and other regions (-13%); 
anticholinergic drugs (12%), p-blockers (1.8%), and benzodiazepines (1%). 

"EPS rate: (number of subjects with treatment-emergent EPS-related adverse effects (irrespective of severity)/total number of subjects randomized in a trial or 
treatment arm). "95% CI of model predictions. c Asymptotic confidence intervals. 

CI, confidence intervals; EPS, extrapyramidal symptoms. 
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Figure 1 Six representative individuals and their transitions between extrapyramidal symptom (EPS) states. Values on the x-axis are nominal visit 
days. The majority of the patients had no EPS, i.e., had a similar shape as patient 50,001 . 



Differential equations used to model the probability of 
observing EPS event 

d/l(1 )/df = KB 2 , x A(2) - KF, 2 x A{\ ) 

d4(2)/df = KF :2 x AO) + KB 32 x A(3) 
-KB 2: xA(2)-KF 23 xA{2) 

dA(3)/dt = KF 23 x A(2) - KB 32 x A(3) 

KF, 2 = 6ase 12 x exp(-/c 12 x time) x (drug effect) 
KB 21 = Base 21 x exp ( - /c 21 x time) 

KF 23 = Base 23 x exp ( - k 23 x time) x (drug effect) 
KB 32 = Base 32 x exp ( - k 32 x time) 
KF and KB are the forward and backward transition 

xy xy 

probability rate constants at any given time; Base xy , the tran- 
sition probability rate constant at the start of the study; x, the 
present EPS state; y, future EPS state; f (1/2) = In 2/k xy ; f 1/2 , 
half-life describing the change in KF xy or KB xy with time; drug 
effect, the effect of antipsychotic drug on KF xy ; EFF, the drug- 
dependent slope parameter in relation to drug exposure; E max , 
the maximum drug effect on the transition rate from state x 
to state y, FtO m , the model parameter that corresponds to 
compound-independent D 2 RO required for 50% of E max effect 
on the linear scale, which is then exponentiated; and /4(1), 
A(2), A(3) represent the compartments for EPS probabilities. 

Inclusion of interindividual variability as an exponential 
function to describe differences between patients' sensitivity 
to treatment effects resulted in an improved model fit by objec- 
tive function; however, the model was numerically unstable, 
and parameters were estimated with less precision and simu- 
lation properties worsened, possibly due to non-normal dis- 
tributions of empirical Bayes estimates that frequently arise 
for categorical-type models. Therefore, the model was built 



without interindividual variability in the typical parameters. 
Visit 4, scheduled to be between day 14 and day 21 (except 
LMU study), corresponds to the point in the study at which 
subjects were allowed to enter into an outpatient status. The 
improvement in the model fit and in visual predictive checks 
showed that it was important to allow some parameters to 
have different values before and after visit 4 (-day 16). 

The effect of predictors was only significant to estimate for- 
ward transition rate constants (i.e., KF 12 and KF 23 ). On the 
basis of NONMEM objective function value, C ss was better 
than dose (decrease of -45 objective function value units) in 
describing the drug-EPS relationships. The final EPS model 
structure (based on all drugs simultaneously) was able to 
describe the observed EPS occurrence adequately with 
acceptable low relative standard errors. 

To characterize the relationship between D 2 RO by different 
APs and the emergence of EPS, predicted D 2 RO levels asso- 
ciated with C were linked to the transition rate constants by 

SS J 

either using a linear function (Eq. 3) or sigmoidal function 
(Eq. 4). The advantage of this transformation is that it allows 
Q to have a value from zero to infinity for D 2 RO from 0 to 
100% and the drug effect to reach its maximum effect (E max ) 
for D 2 RO approaching 100% (Eq. 4). This parameterization 
resulted in statistically better and numerically more stable 
estimation than using D 2 RO directly. 

The parameter estimates of the EPS model when using 
C ss and D 2 RO as predictors are shown in Table 2. The dop- 
amine D 2 RO needed for half of the maximum effect of APs 
on the transition rate was found to be 86.5% on the linear 
scale and 89.5 counting the exponential parameterization 
(Eq. 4). The probabilities for the different states vs. predicted 
individual D 2 RO (based on C ss and K d ) for different APs are 
depicted in Figure 3. Probabilities of experiencing EPS 
rapidly increase at above 80% occupancy. Haloperidol and 
JNJ-37822681 exhibited higher EPS probabilities at some- 
what lower D 2 RO levels. Although different slopes were 
found for each compound, no statistically different differ- 
ences between compounds were found for the effect param- 
eters of the D 2 RO model. 
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For the placebo model, the maximum probability of expe- 
riencing mild EPS (7%) was estimated to be around day 25, 
whereas the maximum probability of experiencing moderate/ 
severe EPS (1.6%) was estimated to occur at day 8. After 
these peaks, the probability slowly declines for both states. 

Olanzapine was found to be less associated with EPS events 
than placebo treatment, causing difficulties in estimating the 
effect of olanzapine on EPS transitions and also causing 
model and estimation instability when analyzed simultane- 
ously with the data from the other drugs. The EPS incidence 
was higher (15%) for the olanzapine arm as compared with 
the placebo treatment in one of the studies (SCH-2002), but 
individual plasma olanzapine profiles were not available from 
this study, which may have contributed to difficulties in estimat- 
ing the effect of olanzapine exposure effect on the probability 
of EPS. The olanzapine data were therefore omitted from the 
analysis. Including the data and fixing the effect to zero yielded 
no significant changes to model parameters. 
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Figure 2 Extrapyramidal symptoms (EPS) continuous-type Markov 
model structure with compartments representing probabilities (no EPS, 
mild EPS, and pooled moderate/severe defined as compartments 1 , 
2, and 3, respectively). The forward rate transitions constant KF 12 and 
KF 23 were allowed to be influenced by drug exposure or D 2 -receptor 
occupancies. 



Covariate model 

Covariates were included in the model based on their statisti- 
cal and clinical significance. The final EPS model included 
only one covariate in addition to in/outpatient status (regional 
difference: Eastern Europe vs. others), which was added as a 
proportional linear term to the corresponding transition prob- 
ability. Residing in Eastern Europe increased the chances of 
improvement of the EPS side effects as it increased back- 
ward movement probability rate constants (KB 21 and KB 32 ) by 
-100% (Table 2). Not all covariate information was available 
for all trials to test the influence of covariates on the probability 
of EPS. Only paliperidone trials had co-medication and com- 
plete demographic details. On the basis of paliperidone data 
only, administration of anticholinergic drug for the treatment 
of EPS was found to be an influential covariate, decreasing 
the transition probability rate constant for movement from a 
mild EPS state to moderate/severe EPS states by -80%. 

Model evaluation 

The final models (Table 2) were evaluated using a boot- 
strap analysis with 1,000 samples. Confidence intervals of 
95% were constructed for each of the parameters and none 
of these overlapped zeros. The population estimates of the 
final model are in close agreement with the median values 
of the 952 successful bootstrap replicates. Visual predictive 
checks using 100 simulated data sets were made to evaluate 
the predictive ability of the model. The model was capable 
of satisfactorily predicting the proportions of the patients 
experiencing each of the EPS states across time (Figure 4). 



Table 2 Parameter estimates (95% confidence intervals from bootstrap analysis) of the final EPS models using C aa and D 2 -receptor occupancy as predictors of EPS 



Predictor 


Steady-state exposure (linear model) 


D 2 -receptor occupancy (£ ms> model) 


Parameter 


<Day16 >Day16 


<Day16 >Day16 


Base 12 (day -1) 


0.0178 (0.014-0.022) 


0.0186 (0.015-0.022) 


Base 21 (day -1 ) 


0. 1 35 (0.1 04-0.1 7)» 0.0703 (0.051-0.096)" 


0.1 34 (0.1 07-0.168)" 0.078 (0.06-0.1 0)" 


Base 23 (day -1 ) 


0.263(0.183-0.310) 0.0703(0.051-0.096)" 


0.369 (0.252-0.522) 0.078 (0.06-0.10)" 


Base 32 (day -1 ) 


0.135 (0.104-0.17)" 


0.134(0.107-0.168)" 


f K for KF, 2 (days) 


8.8 (7.2-10.6)" 


8.9(7.5-10.0)" 


t A for KF 23 (days) 


2.9(2.1-3.7) 8.8(7.2-10.6)" 


2.7 (2.2-3.3)" 8.9 (7.5-1 0.0)" 


f K for KB 21 and KB 22 (days) 


22 (14.8-33.2) 


20(14.7-27) 


EFF. haloperidol 


2.4 (1 .43-2.84) 




EFF. paliperidone 


0.0198 (0.011-0.032) 




EFF. ziprasidone 


0.0089 (0.0045-0.0142) 




EFF. JNJ-37822681 


0.0194 (0.0112-0.029) 




EFF. olanzapine 


0 b 


0 6 


Effect of residence in Eastern 
Europe on KB 21 and KB 32 


0.79 (0.27-1.55)° 


1.08 (0.58-1.73) 


E mm 




1 .73" (0.97-3.0) 


RO 50 (%) 




86.5 s (75.9-95.3) 


y (shape parameter) 




1 .3 d (0.78^1.8) e 


OFV 


7,740 (7,130-8,281) 


7,963 (7,426-8,451) 


"Shared parameter estimates. "Olanzapine not included in final estimation, estimating olanzapine with all data caused model to crash, olanzapine alone yielded 



negative effect, and fixing EFFio zero had no significant effect on other parameters. The covariate effect was expressed as a proportional increase in the parameter 
value by the covariate. "Single drug effect parameter was estimated, "y does not appear to be significantly different from 1 as 1 is included in confidence interval: 1 .3 
(0.78-4.8). 

EFF, effect; EPS, extrapyramidal symptoms; OFV, objective function value; RO, receptor occupancies. 
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Figure 3 Probabilities of extrapyramidal symptom (EPS) events for the C ss model vs. predictions of drug occupancy based on C ss . Green is the 
probability of never experiencing EPS. Black is the probability of experiencing mild but never moderate/severe EPS. Red is the probability of ever 
experiencing moderate/severe EPS. All probabilities are based on 6-week trials. 



Predicted overall EPS incidence coincides with observed 
incidence (Table 2). The number of transitions simulated 
from the model was found to be reasonably consistent with 
the observed number of transitions as shown for the paliperi- 
done data (Figure 5). 

DISCUSSION 

This work describes a pharmacokinetic-pharmacodynamic 
modeling approach that successfully characterized the tempo- 
ral course of the proportions of patients experiencing different 
grades of EPS following exposure to one of four different APs 
or placebo. The dependency of a future EPS event on the cur- 
rent state was accounted for by using a compartmental struc- 
ture, defined by differential equations, for the probabilities of 
observing each severity grade at any time point (Figure 2). 911 
The probabilities were thereby continuous with respect to time 
and coupled to the observed scores through a probabilistic 
model. Markov elements can also be incorporated in a pro- 
portional odds model, 12 however, that type of model is discrete 
in time and the sampling times and frequencies can greatly 
influence the parameter estimates. 13 The analyzed studies 



included self-reported EPS events, and consequently the 
EPS observations were not equally spaced in time. Therefore, 
the continuous time Markov modeling approach was chosen 
and was shown to effectively handle the dependency between 
successive observations of ordered adverse events. 

The simultaneous fit of the model to all data resulted in one 
set of parameter estimates that to an adequate degree could 
simulate the proportions of patients experiencing EPS after 
treatment with one of four different compounds studied in 
seven different trials (Figure 4). The simulations of the transi- 
tions between different states show that the model cannot re- 
create exactly every transition seen in the data, but in relation 
to the huge differences between the occurrence of the differ- 
ent transition types, from 0.1% to above 90%, we conclude 
that the overall pattern of transitions can be described by 
the model (Figure 5). A linear model with respect to steady- 
state concentrations was better than using the predicted 
D 2 -receptor occupancy as a direct link to EPS. The findings 
shown in Figure 3 concur with what de Greet et al. 4 found 
on the metadata level, where the incidence rate increases 
at occupancy >80%. The fact that separation between the 
effect parameters of the substances for the D 2 RO model was 
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Figure 4 Visual predictive checks showing the proportions of the patients at each extrapyramidal symptoms (EPS) state on planned visits in the 
observed data (red lines) with the corresponding 95% prediction intervals as constructed from 100 simulations (light blue region) for different 
antipsychotics, using C ss as a predictor. 



not possible, and the substantially higher objective function 
value for the D 2 RO model, suggests the information content 
in the predicted D 2 RO was relatively low. This indicates that 
the extrapolation of D 2 RO from position emission tomography 
studies may not be perfect or that receptor systems other 
than D 2 are being involved, which is also what is believed to 
be the case for ATAPs. 

The change in parameter estimates between inpatient and 
outpatient periods implies that moderate/severe AEs are more 
likely during hospitalization and that AE events were shorter 
while being inpatients, e.g., because of better access to care- 
givers and rescue medication. A 100% increase in forward rate 
constants corresponds to a 50% decrease of the half-time to 
having a certain probability of an event, as compared with pla- 
cebo. The model dependent on the D 2 -receptor occupancy is 
not drug dependent and can be used to predict EPS for a new 
D 2 -receptor antagonist using the drug K d and information on 
the typical pharmacokinetic profile. The model can also simu- 
late the longitudinal correlations seen in EPS AE data. 

The model predicts an asymptotic decline of the rate con- 
stants towards zero at infinite time. Extrapolation of the model 
into time frames substantially longer than the trial length of 6 
weeks is therefore not endorsed. 

It has been suggested that ATAPs induce EPS 4 at a lower 
rate than typical antipsychotics. The EPS occurrence rate 
was -16 times higher for haloperidol than for ATAPs. Halo- 
peridol exhibited higher EPS occurrence rate even at the 
lower doses of <10mg/day. 



The open-label study of haloperidol with higher doses and 
higher EPS incidence could potentially influence the esti- 
mates for haloperidol. A visual predictive check per study 
did, however, show that the present model could predict EPS 
after haloperidol both in the open-label study and when used 
as comparator (data not shown). 

Study region was found to be an important covariate wherein 
patients who had studied in Eastern Europe had a lower inci- 
dence and shorter average event lengths of EPS than those 
from other countries. The reason for this is not clear, but regional 
differences in study results are not uncommon; different atti- 
tudes toward reporting adverse events could be a possibility. 

The present EPS model did not consider dropout. How- 
ever, EPS was not the major reason for discontinuation of 
treatment, and discontinuation, primarily, was due to lack of 
efficacy and subject's choice. 

Overall, this data analysis indicated that olanzapine was 
well tolerated in patients with schizophrenia as it was not 
possible to estimate a slope parameter for the effect (EFF in 
Eq. 3) due to model instability when including the olanzapine 
data. It may be that olanzapine has a favorable EPS profile 14 
due to binding to receptors such as 5-HT 2A , but that olan- 
zapine would truly have lower incidence rates than placebo 
seems unlikely. Fixing the olanzapine effect to zero and esti- 
mate using all data did not change the other parameters sig- 
nificantly, but as modeling the olanzapine data alone yielded 
a negative effect, and due to the model instability, the data 
were still left out of final estimation. 
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Figure 5 Visual predictive check of Markov model transitions for paliperidone treatment. The gray area represents the 10th and 90th interpercentile 
range of the simulated number of transitions. Solid line indicates the median observed transitions. 



In conclusion, a model that can characterize the temporal 
course of the proportions of patients experiencing different 
grades of EPS using a compartmental model structure incor- 
porating Markov elements was successfully developed. To our 
knowledge, this approach has not been used for character- 
izing side effect data in general, and no population models 
have been developed for EPS side effects. The approach 
could be used for any adverse event with severity grading 
and a reported duration. The model quantifies the relationship 
between the occurrence of EPS and movement to higher EPS 
states and the different predictors of exposure (dose, C ss ), as 
well as receptor occupancy of the different APs. 



METHODS 

Studies, patients, and EPS scores. The EPS modeling 
used individual-level data obtained from six randomized, 
placebo-controlled, clinical trials and one open-label study 
conducted in schizophrenic patients. The study durations 
ranged from 4 to 12 weeks, following oral administration 
of one of five APs (haloperidol, olanzapine, paliperidone- 
extended release, ziprasidone, and JNJ-37822681). The 
studies were included on the basis of availability of EPS 
AE data and being of roughly the same length with weekly 
follow-ups. 
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EPS-related AEs included side effects that were reported 
spontaneously by patients over the study period. The impor- 
tant AEs documented were akathisia, hyperkinesia, dystonia, 
Parkinsonism, dyskinesia, tardive dyskinesia, hypokinesia, 
and tremor. As the total number of events was too low for 
some AEs to draw conclusions about the exposure-response 
relationship, not all types of EPS-related AEs were observed 
in all trials and there were unspecified EPS AEs as well; the 
model was developed without discriminating between the dif- 
ferent types of AEs. 

According to the design of the studies, patients met clini- 
cians in the clinic at least once a week during the total study 
duration. Patients were directed to record the incidence of 
EPS, the duration of the EPS episode, and resolution of any 
EPS, the severity of which was graded by clinicians on a scale 
from 0 to 3 (0: no EPS, 1: mild EPS, 2: moderate EPS, and 
3: severe EPS). Thus, transitions were possible on any day 
and not only on visit days. If the patient dropped out before 
the end of the study, all available EPS scores until the day of 
dropout were included in the analysis. If several manifesta- 
tions of EPS were experienced simultaneously, but differing 
in grade, the grade was set to the highest. In all trials, patients 
were hospitalized for the first 2-3 weeks of the study period. 

Data were analyzed by nonlinear mixed-effects modeling 
using the LAPLACE method in NONMEM 7, level 1.2, 15 with 
front-end interface PsN 3. 4. 2. 16 R version 2.11 and higher 
versions were used for data management purposes and gen- 
erating graphic outputs. 17 

Pharmacokinetics. A patient-specific average steady-state 
concentration (C ss ) was calculated using post hoc Bayes- 
ian estimates of clearance (C ss = Dose/(CUFx T) where T 
is the dosing interval) obtained from previously developed 
pharmacokinetic models. 1819 The typical apparent clearance 
(CUF) estimates were 88 l/h for haloperidol, 14 l/h for pali- 
peridone, 20 l/h for olanzapine, 54 l/h for ziprasidone, and 25 
l/h for JNJ-37822681 . The calculated individual C was then 

SS 

linked to the time course of EPS incidence. C was set at 0 

SS 

for subjects receiving placebo and was considered constant 
over time. 

EPS and likelihood model structure. EPS events were catego- 
rized on an ordered categorical scale based on the intensity 
of EPS-related AEs. Because there were few observations on 
severe EPS, the moderate and severe EPS states were com- 
bined and a three-state scale was used. A Markov transition 
model with three compartments (Figure 2) was used where 
each compartment represented the probabilities of a differ- 
ent state (no EPS, mild EPS, and moderate/severe EPS). 
The probability at t = 0 was set to 1 for the observed EPS 
state. The amount corresponding to probability was allowed 
to distribute between the compartments, and the first-order 
rate constants between the compartments were estimated. 
After an observation, all compartments were reset to zero 
and the compartment corresponding to the observed EPS 
state of the patient was initialized with a 100% probability, 
f was not reset at each event. The model for the probabili- 
ties given the data is shown in Eq. 5 where the probability 
of Y p the observed state at the /th observation of individual 
/, is given by the amount in the compartment corresponding 



to state k at observation / for individual /. The likelihood was 
evaluated at scheduled time points (typically once per week) 
and at state changes on nonscheduled days 

p<y, = k) = m, (5) 

Effects of time, drug exposure, receptor occupancy, and 
covariates on transition probabilities were evaluated in the 
Markov model as a proportional relation on the transition 
rate parameters. Drug and covariate effects were tested on 
each transition parameter separately and in combination. 
The model control stream can be found as Supplementary 
Table S1 online together with an example data set. 

Placebo effect and drug effect. Various functions such as 
constant, linear, exponential, and Weibull functions were 
explored for describing a change over time in the transition 
probability rate constants. The antipsychotic drug exposure 
was related to the EPS incidence with increasing complexity 
using linear, E max , and sigmoid E max models and tested on top 
of parameters estimated for the placebo group. To character- 
ize the relationship between EPS incidence and dopamine 
D 2 RO levels, the following relationship was used to calculate 
D 2 RO for each patient: 



where RO max is the maximum receptor occupancy and K 6 is 
the plasma level of antipsychotic drug associated with 50% of 
RO max . The values of K d for D 2 -receptor binding were obtained 
from the literature, where E models were used to fit D,RO 

' max 2 

and plasma drug concentration data obtained from position 
emission tomography studies. The K A values for D 2 -receptor 
binding (assuming RO max 100%) were 0.56ng/ml for haloperi- 
dol, 12ng/ml for olanzapine, 4.9ng/ml for paliperidone, 33 ng/ 
ml for ziprasidone, 20 and 15ng/ml for JNJ-37822681 . 21 

Covariate model. Influences of patient- and study-specific 
covariates were evaluated as possible explanatory variables 
for the individual variability in the model parameters (Table 1). 
The potential effect of concomitant medications for treating 
EPS was tested using the data from paliperidone trial where 
exact time of start and stop of these medications were known. 

Covariates were included in the model using different func- 
tional forms: linear, piecewise linear, power, and exponential 
functions. 19 Only nonmissing, clinically relevant, and uncor- 
rected covariates that met the predefined statistical criteria 
(P< 0.05) were included in the EPS model. 

Final model selection and model evaluation. During initial 
model building, differences in the objective function value (cut 
off: 3.84) between the models together with % relative stan- 
dard error (from NONMEM covariance step) of the parameters 
were used to guide the selection of the model. A bootstrap 
analysis (1,000 samples) was carried out, for both the drug 
exposure-EPS and the receptor occupancy-EPS models, to 
check the precision of the estimates and to construct a 95% 
confidence interval for each of the parameter estimates. The 
adequacy of the model was investigated with simulation- 
based visual predictive checks. Briefly, prediction intervals of 
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the proportions of patients at each EPS state at each planned 
observation and transitions between the different EPS states 
were constructed using 100 (due to heavy calculations) simu- 
lated replicates of the initial data set and compared with the 
corresponding observed proportions or transitions. 

Author Contributions. V.P.R., K.J.R A.A.S., A.V., J.H.P., and 
L.E.F. wrote the manuscript, designed the research, performed the 
research, and analyzed the data. 

Acknowledgments. K.J. P. was supported by a grant from Jans- 
sen Research & Development (Beerse, Belgium). V.P.R. was sup- 
ported financially by the Dutch Top Institute Pharma (Leiden, The 
Netherlands; www.tipharma.com) within the framework of project 
no. D2-104 (Mechanism-based pharmacokinetic-pharmacodynamic 
modeling platform). We thank Jing Liu (Pfizer Global Research 
and Development, Groton, USA) for her contribution to this 
article via Top Institute Pharma. We also thank Dan Rujescu 
(Department of Psychiatry, Ludwig Maximilians University, Munich, 
Germany) for sharing the haloperidol data. We thank Geny M.M. 
Groothuis, Meindert Danhof, and Magdalena Kozielska for their 
scientific input. 

Conflict of Interest. As an Associate Editor for CPT.PSP, L.E.R was 
not involved in the review or decision process for this paper. 



Study Highlights 

WHAT IS THE CURRENT KNOWLEDGE ON 
THETOPIC? 

Data comprising spontaneously reported, graded, 
adverse events are difficult to analyze and have been 
modeled through proportional odds or logistic models 
that require categorization or binning of the data. 

WHAT QUESTION DID THIS STUDY ADDRESS? 

The study investigated if the severity and duration of 
adverse events can be simultaneously modeled based 
on individual-level data and if there is a set of system 
parameters for the five different compounds included 
in the analysis that could be used in drug develop- 
ment for predicting EPS-related events of D 2 -receptor 
antagonists. 

WHAT THIS STUDY ADDS TO OUR KNOWLEDGE 

A compartment-based Markov model can successfully 
describe and simulate longitudinal adverse event data 
in patients with schizophrenia treated with D 2 -receptor 
antagonists. 

HOWTHIS MIGHT CHANGE CLINICAL 
PHARMACOLOGY ANDTHERAPEUTICS 

The model can be applied in drug development to charac- 
terize and simulate time courses of EPS-related adverse 
events and for the prediction of EPS in patients based on 
phase I occupancy data. 
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